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Abstract 

The increasing interest in renewable energy, particularly in wind, has given 
rise to the necessity of accurate models for the generation of good synthetic 
wind speed data. Markov chains are often used with this purpose but bet- 
ter models are needed to reproduce the statistical properties of wind speed 
data. We downloaded a database, freely available from the web, in which are 
included wind speed data taken from L.S.I. -Lastem station (Italy) and sam- 
pled every 10 minutes. With the aim of reproducing the statistical properties 
of this data we propose the use of three semi-Markov models. We generate 
synthetic time series for wind speed by means of Monte Carlo simulations. 
The time lagged autocorrelation is then used to compare statistical proper- 
ties of the proposed models with those of real data and also with a synthetic 
time series generated though a simple Markov chain. 

Keywords: Wind models; semi-Markov chains; synthetic time series; 
autocorrelation 

1. Introduction 

The increasing interest in renewable energy leads scientific research to 
find a better way to recover most of the available energy. Particularly, the 
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maximum energy recoverable from wind is equal to 59.3% of that available 
(Betz law) at a specific pitch angle and when the ratio between the wind speed 
in output and in input is equal to 1/3. The pitch angle is the angle formed 
between the airfoil of the blade of the wind turbine and the wind direction. 
Old turbine and a lot of that actually marketed, in fact, have always the same 
invariant geometry of the airfoil. This causes that wind turbines will work 
with an efficiency that is lower than 59.3%. New generation wind turbines, 
instead, have a system to variate the pitch angle by rotating the blades. This 
system allows the wind turbines to recover, at different wind speed, always 
the maximum energy, working in Betz limit at different speed ratios. A 
powerful system control of the pitch angle allows the wind turbine to recover 
better the energy in transient regime. A good stochastic model for wind 
speed is then needed to help both the optimization of turbine design and to 
assist the system control to predict the value of the wind speed to positioning 
the blades quickly and correctly. The possibility to have synthetic data of 
wind speed is a powerful instrument to assist designer to verify the structures 
of the wind turbines or to estimate the energy recoverable from a specific site. 
To generate synthetic data, Markov chains of first or higher order were often 
used [U El [31 Ej. In particular in PQ is presented a comparison between a 
first-order Markov chain and a second-order Markov chain. A similar work, 
but only for the first-order Markov chain, is conduced by [2], presenting 
the probability transition matrix and comparing the energy spectral density 
and autocorrelation of real and synthetic wind speed data. A tentative to 
modeling and to join speed and direction of wind is presented in [3]. by using 
two models, first-order Markov chain with different number of states, and 
Weibull distribution. The Markov assumption is widely used in other closely 
related topics, see for example [5J Ej . 

All these models use Markov chains to generate synthetic wind speed time 
series but the search for a better model is still open. Approaching this issue, 
we applied new models which are generalization of Markov models. More 
precisely we applied semi-Markov models to generate synthetic wind speed 
time series. 

Semi-Markov processes (SMP) are a wide class of stochastic processes 
which generalize at the same time both Markov chains and renewal pro- 
cesses jTJ |8] . They have been widely used in the literature to model natural 
phenomena (see for example j9l |10l HH [12j [131 E2 US] ) . Their main advantage 
is that of using whatever type of waiting time distribution for modeling the 
time to have a transition from one state to another one. This major flexibil- 
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ity has a price to pay: availability of data to estimate the parameters of the 
model which are more numerous. Data availability is not an issue in wind 
speed studies, therefore, semi-Markov models can be used in a statistical 
efficient way. 

In this work we present three different semi-Markov chain models: the 
first one is a first-order SMP where the transition probabilities from two 
speed states (at time T n and T„_i) depend on the initial state (the state 
at T n _i), final state (the state at T n ) and on the waiting time (given by 
t = T n — T n _i). The second model is a second order SMP where we consider 
the transition probabilities as depending also on the state the wind speed 
was before the initial state (which is the state at T n _ 2 ) and the last one is 
still a second order SMP where the transition probabilities depends on the 
three states at T n _2, T n _i and T n and on the waiting times t\ = T n _i — T n _2 
and £2 = T n — T„_i. The three models will be extensively explained in 
the next sections. The three models are used to generate synthetic time 
series for wind speed by means of Monte Carlo simulations and the time 
lagged autocorrelation function is used to compare statistical properties of 
the proposed models with those of real data and also with a time series 
generated though a simple Markov chain. The probability density function of 
real and simulated data are also compared for the model which is recognized 
to be the best among the proposed ones. 

In this paper, for the first time, different second order discrete time semi- 
Markov chains are defined and general formulae of transition probabilities 
with initial and final backward are presented. 

The paper is organized as follows: in Section 2 we describe the stochastic 
models and we derive relevant results. Section 3 demonstrates the models 
applied to a real dataset by testing the semi-Markov hypothesis and by com- 
puting the autocorrelation functions and the probability density functions of 
the wind speed. Finally Section 4 presents some concluding remarks. 

2. Wind speed modeling with semi-Markov chains 

Semi-Markov chains are a generalization of Markov chains allowing the 
times between transitions to occur at random times according to any kind of 
distribution functions which may depend on the current and the next visited 
state. As it is well known, Markov chains have sojourn times between tran- 
sitions geometrically distributed, for this reason the memoryless property is 
preserved and no duration effect is observed. The more general semi-Markov 
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environment allows the possibility to use also no memoryless distributions 
and then can reproduce a duration effect. The duration effect affirms that 
the time the system is in a state influences its transition probabilities. The 
states of the process in our data are represented by different wind speed val- 
ues, then in this paper we detect the presence of a duration effect in wind 
speed modeling and forecasting. Given that the data on wind speed are 
recorded naturally in discrete time and in discrete values we develop also the 
theoretical model in discrete time and discrete values. 

Here below we propose a semi-Markov model of order two in state and 
duration and we compare its performance with the Markov chain models of- 
ten used to describe wind speed, see [H |2J E] and with some particular cases 
of our semi-Markov chain model. 

Let us consider a finite set of states E = {1,2, ...,5} in which the system 
can be into and a complete probability space (fl, F, P) on which we define 
the following random variables: 

J n -.n^E, T n : ft ->■ N. (1) 

They denote the state occupied at the n-th transition and the time of 
the n-th transition, respectively. To be more concrete, by J n we denote the 
wind speed at the nth transition and by T n the time of the nth transition 
of the wind speed process. We do the following conditional independence 
assumption: 

P[J n+ i = j, T n+1 -T n = t\a(J s , T s ), J n = k, J n _i =i,T n - T n _i = x, < s < n] 

= P\Jn+x = jjT n +i T n = t\ J n = k, J n -\ = i,T n T n —\ = %] - = xQi.k,j\t)- 

(2) 

Relation Q asserts that, the knowledge of the values J n , J n _i,T„ — T n _i 
is sufficient to give the conditional distribution of the couple J n+ i,T n+ i — 
T n whatever the values of the past variables might be. Therefore to make 
probabilistic forecasting we need the knowledge of the last two visited state 
and the duration time of the transition between them. For this reason we 
called this model a second order semi-Markov chains in state and duration. 

The conditional probabilities 

xQi.k,j (^) P\Jn+X ji T-n t\Jn k, J n ^\ Z, T n T n —\ x] 

are stored in a matrix of functions q = ( x Qi.kj{t)) called the second order 
kernel in state and duration. The element x Qi.k,j (t) represents the probability 
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that next wind speed will be in speed j at time t given that the current wind 
speed is k and the previous wind speed state was % and the duration in wind 
speed % before of reaching the wind speed k was equal to x units of time. 
We can define the cumulated second order kernel: 

xQi.k,j{t) ■ P[Jn+l ji 2"n+l T n <J 1 1 J n k, J n —1 2, T n T n —\ x\ 

t 

= ^xqi.k,j{s). 

s=l 

(3) 

The process {J n } is a second order Markov chain with state space E 
and transition probability matrix X P = x Q(oo). We shall refer to it as the 
embedded Markov chain. 

Let us consider the unconditional waiting time distribution function in 
states % and k with duration x as 

xHi.k(t) := P[T n+ i — T n < t\J n = k, J n -\ = i,T n — T n _i — x\ — ^ ] xQi.kjjt)- 

(4) 

The conditional cumulative distribution functions of the waiting time in 
each state, given the state subsequently occupied is defined as 

xGi.k,j{t) — P[T n +i — T n < t\J n = k, J n -i — i, J n +i = 3iT n — T n _\ = x] 
2_^xqi.k,j{s) ■ i{ xPi k ^o} + i{ xPik:j =o}, 



xPi.k 



3 s=l 



where, in general, l{ a =b} is 1 if a = 6 and zero otherwise. 

Now let N(t) = sup{n : T n < t} Vt G N be the number of transitions up 
to time t, then the second order (in state and duration) semi-Markov chain 
can be defined as Z(t) = (Z 1 ^), Z 2 (t)) = (Jjv(t)-i, Jjv(t))). 

For all i,k,j G E, and t G N, we define the semi-Markov transition 
probabilities: 

x (/>i.k,h.j(t) ■— P[JN(t) = j, Jn(i)-i = h\J N ( ) = k, Jn(o)-i = i,TN(o) = 0, Tjv(o)— 7jv(o)-i = x ], 

(6) 

then the following system of equations is verified: 

t 

x<f>i.k,h.j(t) = l{i=/i,fe=j}(l — x Hi.k(t)) + ^2 xqi.k,r( S ) s</>k.r,h.j(t ~ s). (7) 

rg_B s=l 
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Figure 1: Initial and final backward values 



The proof of equation ([7]) is not given here because it is a particular case 
of the equation established and proved later. 

To detect the duration effects let us introduce the backward recurrence 
time process defined for each time t G N by: 

B(t) = t-T N(t) . (8) 

If the semi-Markov process Z(t) indicates the wind speed at time t, the 
backward process B(t) indicates the time since the last transition, that is 
from how long time the wind speed is at the value Z(t). 

In Figure [T] a trajectory of a semi-Markov process with initial and final 
backward times is reported. In this figure we have that N(s) = n and 
N(s + 1) — h — 1, the backward process at time s is B(s) = s — T n = v and 
the backward process at time t + s is B (t + s) = t + s — T /i _ 1 = v'. 

To quantify the duration effect in our second order semi-Markov model, 
let us define the following probabilities: 

b x$.k,h.j(v;v',t) : = 

P[JN{t) = j,B(t) = v', J N (t)-i = h\J N (Q) = k, Jjv(o)-i = i,B(0) = v,T N ( ) - Tjv( )-i = x}. 

(9) 

Expression ^ gives the probability that the wind speed will enter in the 
state j at time t — v ' coming from state h and will remains inside the state 
j without any other transition up to the time t given that at the present 
the wind speed is k and it entered into this state with the last transition v 
periods before coming from a wind speed equal to % with a duration in i of x 
periods. 



6 



Proposition 1. The relation (10) represents the evolution equation o/Q.' 

[1 - x H Lk (t + v)} 

(10) 



b 6 b 



k,h,j( V 'i V 'i t) — ^-{i=h,k=j,v'=t+v}- 



[1 - x Hi. k (v)] 



t-v' 



. xQi.k,r{S + V) b , . , 

+ SSiws^)i' +A ^ (0;t '' ( " s) ' 

Proof: For simplicity of notation, suppose the counting process iV(0) = 0, 
and denote by 

x A Lk {v\ 0) = {J = k, J-x = i, P(0) = v,T - T_i = x}. 

Then we have 

b jJ> 



= P[J m = j, B{t) = v', J m _ t = h,T x > t\ x Ai. k (v; 0)] 
+ P[JN(t) = J, B(t) = v', J N (t)-i = h, Ti < t\ x A Lk (v; 0)]. 



(11) 



Observe that 



P[Jn(i) = j, B(t) = v', J N{t )-i = h,T 1 > t\ x A Lk (v; 0)] 
= P[Jn{€) = J, B(t) = v', J m _ x = h\T x > t, x A t . k (v; 0)] (12) 
■ P[T 1 >t\ x A l . k (v;0)]. 

If Ti > t then Jjv(t) = Jo? Jjv(t)-i — J-x an d B{t) = v ' = v + t. This gives: 

P[Jn{i) = j, B(t) = v', J N ( t )-x = h,Ti> t\ x Ai. k (v; 0)] 
= P[k = j,v' =v +t,i = h\Tx > t, x Ai, k (v; 0)] 
■ P[Ti > t\ Jo = k, J_i = i, T - T_! = x, To = -v, T x > 0] 

P[Ti > f| Jo = fc, J-i = h To ~ T-x = x,T = -v] (13) 



1 



1 -*#i.k(t + v) 



{fe= i j,i=/i,i;'=u+t} " 



1 -x Hi.Jv) 



The second addend on the right hand side of (11) can be represented as 
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follows: 



t-v' 



^ P[Jn(!) = h B(t) = v', J N {t)-i =h,Jx = r, T x = s\ x A Lk (v; 0)] 

rS-E s=l 

t-v' 

= ^2^2 P \. J N{t) = J, B(t) = v', J N ( t )-i = h\J 1 = r, Ti = s, x A Lk (v; 0)] 

r£E s=l 

•P[Ji = r,T 1 = s| SB A i . fc (T;;0)] 

t-v' 

= ^2^2 P \. J N{t) = j, B(t) = V, J N ( t )-l = h\ s+v A k . r (0; s)] 

r£E s=l 

■ P[Ji = r,Ti - T = s + v\J = k, J_i = i,T = —v, T\ > 0, T - T_i = x] 

= Y.12sM,, h ,^',t-s) 

r£E s=l 

P[Ji = r, Ti - T = s + v | J = k, J_i —i,T — T_ x = x] 
P[Ti - T > v\ J = fc, J-i = i, T - T_i = x] 



r6-E s: 



^ [1 — x iJ 



7~yj s+^0fc.r,h.j(O! 11 s )- 
■ k\ v )\ 



(14) 



A substitution of (13) and (14) in (11) concludes the proof. 
Obviously we have that 



l<i>i.k,h.j(v,t) 

■= P[JN{t) = j, JN{t)-\ = h\J = k, J_! = i, 5(0) = v, T = 0, T - T_i = x] 

v'>0 

(15) 

Expression (15) represents the probability that the wind speed will be in 
the state j at time t coming from a wind speed equal to h given that at present 
the wind speed is k and it entered into this state with the last transition v 
periods before coming from a wind speed equal to % with a duration in i of x 
periods. 

Notice that, if v — we obtain the equation 

It should be noted that our semi-Markov model of order two in state and 
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duration contains several interesting special cases we will apply in the next 
section. The paper [16] proposed a n-order semi-Markov process (in state) 
in continuous time. The discrete time counterpart of order two (in state) is 
obtained through the following assumption: 

P[J n +i = j, T n+1 -T n = t\a(J s , T s ), J n = k, J n _! = i, < s < n] 
= P[Jn+i = j,T n +i — T n = t\J n = k, J n -i = i] := qi.kj{t). 



Relation (|16j) asserts that, the knowledge of the values J n , J n -\ is sufficient 
to give the conditional distribution of the couple J n+ i,T n+ i — T n whatever 
the values of the past variables might be. Therefore to make probabilistic 
forecasting we need the knowledge of the last two visited state. In the appli- 
cation we will refer to this model as the model named semi-Markov II. 

If we assume that 

P[J n+ i = j, T n+ i -T n = t\a(J s , T s ),J n = i,0<s<n] 
= P[J n +l = j, T n+1 -T n = t\J n = i] := q i:j {t). 

then we recover the classical semi-Markov chain model. Finally remark that 
a Markov chain with transition probability matrix (tij)ij e E is obtained when 



the semi-Markov kernel (17) is given by qij(s) = Uj(tu) s l^j}, s G N— {0} 



3. Application to real data 

To check the validity of our model we perform a comparison of the behav- 
ior of real data and wind speeds generated through Monte Carlo simulations 
based on the models described above. In this section we describe the database 
of real data used for the analysis, the method used to simulate synthetic wind 
speed time series and, at the end, we compare results from real and simulated 
data. 

The data used in this analysis are freely available from \http : / /www. I si — 
lastem.it / meteo / page / dwnldata.aspx . The station of L.S.I. -Lastcm is sit- 
uated in Italy at N 45 28' 14,9" - E 9 22' 19,9" and at 107 m of altitude. 
The station uses a combined speed-direction anemometer at 22 m above the 
ground. It has a measurement range that goes from to 60 m/s, a threshold 
of 0,38 m/s and a resolution of 0,05 m/s. The station processes the speed 
every 10 minutes in a time interval ranging from 25/10/2006 to 28/06/2011. 
During the 10 minutes are performed 31 sampling which are then averaged in 
the time interval. In this work, we use the sampled data that represents the 
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25/10/2006 2007 2008 2009 2010 28/11/2011 

Time 



0.1 




v [m/s] 



Figure 2: Time series of wind speed and its empirical distribution. 



average of the modulus of the wind speed (m/s) without a specific direction. 
The database is then composed of about 230thousands wind speed measures 
ranging from to 16 m/s. The time series, together with its empirical prob- 
ability density distribution are represented in Figure [2} 

To be able to model the wind speed as a semi-Markov process the state 
space of wind speed has been discretized. In the example shown in this work 
we discretized wind speed into 7 states chosen to cover all the wind speed 
distribution. From the discretized wind speeds we estimated the probabilities 
P and G to generate synthetic trajectories by means of Monte Carlo simula- 
tions [T7j for three semi-Markov models: a simple semi-Markov model of the 
first order named semi-Markov I, semi-Markov II a second order semi-Markov 
model in state (as described in section 2) and the second order semi-Markov 
model in state and duration is named semi-Markov III. For comparison rea- 
son, we also generated a synthetic trajectory which follows a simple Markov 
model with transition probability matrix estimated from the real data. We 
then ended up with five trajectories: one representing real data, three rep- 
resenting the three trajectories according to the three semi-Markov models 
and the last one a Markov chain. The time series are used in the following to 
compare results on the time lagged autocorrelation function. Real data are, 
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in fact, strongly autocorrelated and the autocorrelation function decreases 
rapidly with time. We then tested our models to check whether they are 
able to reproduce such behavior. Before doing so we tested the semi-Markov 
hypothesis using an hypothesis test which we are going to describe in the 
next subsection. 

3.1. Test 

The semi-Markov hypothesis is tested applying a test of hypothesis pro- 
posed by [18] and shortly described here below. As already stated, the model 
can be considered semi-Markovian if the sojourn times are not geometrically 
distributed. The probability distribution function of the sojourn time in state 
i before making a transition in state j has been denoted by Gy(-). Define 
the corresponding probability mass function by 

gij(t) = P{T n+1 -T n = t\J n = i, J n+1 = j} = 

Gij(t) — Gij(t — 1) if *> 1 , , 

G fi (l) if t= 1 1 j 

Under the geometrical hypothesis the equality <^-(l)(l — <7y(l)) — <?y(2) = 
must hold, then a sufficiently strong deviation from this equality has to be 
interpreted as an evidence in favor of the semi-Markov model. The test- 
statistic is the following: 

§ _ - & (!)) - &(2)) (1Q) 

where N(i,j) denotes the number of transitions from state i to state j ob- 
served in the sample and Qij{x) is the empirical estimator of the probability 
gij(x) which is given by the ratio between the number of transition from i 
to j occurring exactly after x unit of time and N(i,j). This statistic, under 
the geometrical hypothesis H (or markovian hypothesis), has approximately 
the standard normal distribution, see [18J. 

We applied this procedure to our data to execute tests at a significance 
level of 95%. Because we have 7 states we estimated the 7 x (7 — 1) waiting 
time distribution functions and for each of them we computed the value of 



the test-statistic (19). The geometric hypothesis is rejected for 28 of the 42 
distributions. Due to lack of space, we do not report all the values of the 
test-statistic, but they are available upon request. In Table 1 we show the 
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state state score decision 



l = 1 


J 


= 2 


12.14 


H 


rejected 


i = 1 


J 


= 3 


3.33 


Ho 


rejected 


i = 2 


J 


= 1 


5.64 


Ho 


rejected 


% = 2 


3 


= 3 


9.35 


H 


rejected 



Table 1: Results of the Test 



results of the test applied to the waiting time distribution functions for few 
states. 

The large values of the test statistic suggest the rejection of the Marko- 
vian hypothesis in favor of the more general semi-Markov one. 



3.2. Autocorrelation function 

If Z indicates wind speed, the time lagged (r) autocorrelation of wind 
speed is defined as 

Cov(Z(t + r),Z(t)) 

S(T) = VaAzW) (20) 

The time lag r was made to run from 1 minute up to 1000 minutes. Note 
that to be able to compare results for S(r) each simulated time series was 
generated with the same length as real data. Results shown in Figure [3] indi- 
cate that semi-Markov models reproduce better the autocorrelation present 
in real data especially if a second order semi-Markov chain is used to gener- 
ate synthetic data. We can also notice that the second order semi-Markov 
model in state and duration (Model III) has to be preferred to the second 
order semi-Markov model in state (Model II) because it exhibits a slightly 
higher autocorrelation uniformly in time and also because, asymptotically, 
its autocorrelation has the same slope of that observed in real data whereas 
in the Model II, the autocorrelation drops to zero. 

3.3. Probability density function and trajectories 

From the study of the autocorrelation function we found out that Model 
III should be chosen to generate synthetic trajectories of wind speed data. 
In this subsection we are going to compare the probability density function 
(pdf) of real data and synthetic data. As an example we will show also 
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Figure 3: Time lagged autocorrelation function. 

the two trajectories for a sample period. First of all let us remind that 
to use the semi-Markov approach we discretized the wind speed in a finite 
number of states. We choose 7 so that we can cover all the wind speeds 
in our dataset and, at the same time, each state as a sufficient number of 
occupation. To obtain synthetic wind speeds data comparable with real ones 
a transformation back to continuous speed as to be made. We used the 
following formula 

w c (t) = w d (t) + eA. (21) 

where w c indicates the continuous wind speed at time t, wa(t) the discretized 
wind speed at the same time, e is a uniformly distributed random number 
in the interval [0, 1] and A is the wind speed interval used for discretization. 
We show in Figure [4] an example of real and simulated trajectories while in 
Figure [5] we compare the pdf for both trajectories. 

From Figure [5] it is possible to notice that the pdf for real and synthetic 
data are almost identical supporting even more our model. We only compare 
here the pdf of real data and of the synthetic data from Model III because 
the fitting is already very good and there is very little space for improvement. 
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Figure 4: Trajectories for 160 hours for real and synthetic data. Data are sampled every 
10 minutes in both cases. 
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Figure 5: Probability density function for real and synthetic data 
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4. Conclusions 

Wind speed is a stochastic process for which a completely satisfactory- 
model is still lacking. Many authors have used Markov chain to model the 
process but this approach does not give the same persistence present in real 
data. We presented in this work three semi-Markov models with the aim 
of generate synthetic wind speed data. We have shown that all our models 
perform better than a simple Markov chain in reproducing the statistical 
properties of wind speed data. In particular, the model that we recognized 
as being the more suitable is a second order semi-Markov process in state 
and duration. Although the evidence shows the semi-Markovian nature of 
the studied phenomenon, probably a third/fourth order semi-Markov chain 
would be needed to decrease the difference between autocorrelation of real 
and simulated data. In our view this approach would be too much compu- 
tationally and data consuming and further research on a simplified, but still 
with longer memory, model is needed. In this view, models from the econo- 
physics literature (see for example p3J [13 UHl EH EU [22]) could be tested for 
possible application in wind speed modeling. 

We conclude that semi-Markov models should be used when dealing with 
wind speed data. 
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